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Abstract. We present new preservation theorems that semantically characterize 
the B'^V* and V'^B* prefix classes of first order logic, for each natural number k. 
Unlike preservation theorems in the literature that characterize the 3* V* and V* 3* 
prefix classes, our theorems relate the count of quantifiers in the leading block of 
the quantifier prefix to natural quantitative properties of the models. As special 
cases of our results, we obtain the classical Los-Tarski preservation theorem for 
sentences in both its extensional and substructural versions. For arbitrary finite 
vocabularies, we also generalize the extensional version of the Los-Tarski preser- 
vation theorem for theories. Finally, we present an interpolant-based approach 
towards our results. 
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1 Introduction 

Preservation theorems in first order logic (henceforth called FO) have been extensively 
studied in model theory. A FO preservation theorem for a model-theoretic operation 
syntactically characterizes FO definable classes of structures that are preserved under 
that operation. A classical preservation theorem (also one of the earliest) is the Los- 
Tarski theorem, which states that over arbitrary structure s, a FO sentence is preserved 
under substructures iff it is equivalent to a universal sentence [1]. In dual form, the 
theorem states that a FO sentence is preserved under extensions iff it is equivalent to 
an existential sentence. It is well-known that if the vocabulary is relational, the sizes 
of the minimal models of a sentence preserved under extensions are no larger than the 
number of quantifiers in an equivalent existential sentence. Thus, the dual version of 
the Los-Tarski theorem not only asserts the equivalence of a syntactic and a semantic 
class of FO sentences, but also yields a relation between a quantitative model-theoretic 
property (i.e., sizes of minimal models) of a sentence in the semantic class and the count 
of quantifiers in an equivalent sentence in the syntactic class. 

Counts of quantifiers are known to have a bearing on the parameterized complexity, and 
even decidability, of satisfiability checking of various syntactic classes of FO [2]. For 
example, consider the class of prenex FO sentences, over a relational vocabulary, having 
a prefix structure of the form 3*V*. It is known that satisfiability checking for this class 
is in NTIME((nA:™)'^), where n is the length of the sentence, k and m are the number 
of existential and universal quantifiers respectively in the sentence, and c is a suitable 
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constant [2]. Similarly, for each k >2, satisfiability checking for the class of sentences 
of the form \/''3*Lp where ip is quantifier-free, is undecidable if equality is allowed in 
(fi [2]. It is therefore interesting to study preservation theorems that relate quantitative 
properties of models of sentences in a semantic class to counts of quantifiers of equiva- 
lent sentences in a syntactic class. In recent years, there has been significant interest in 
syntactic classes of FO with one quantifier alternation in the context of program verifi- 
cation, program synthesis and other applications [3-5]. The literature contains several 
semantic characterizations for these syntactic classes using notions such as ascending 
chains, descending chains, and 1 -sandwiches [1] (also see Appendix A). However, none 
of these relate quantifier counts to any model-theoretic properties. In this paper, we take 
a step towards addressing this problem. Specifically, we present preservation theorems 
that provide new semantic characterizations of sentences in prenex normal form with 
quantifier prefixes of the form B'^V* and V'^El*. Our theorems relate the count k of quan- 
tifiers in the leading block of quantifiers to quantitative properties of the models. 
The present work builds on notions introduced earlier in [6] , specifically, those of cores 
and substructures modulo bounded cores. It was conjectured in [6] that for every natural 
number k, a FO sentence is preserved under substructures modulo fc-sized cores iff it is 
equivalent to a prenex sentence with quantifier prefix of the form B'^V*. In this paper, 
we formally prove this conjecture over arbitrary structures. This gives us a preservation 
theorem that generalizes the substructural version of the Los-Tarski theorem for FO 
sentences. Our proof approach consists of introducing a notion dual to that of substruc- 
tures modulo fc-sized cores, and then proving a dual version of the original conjecture. 
Interestingly, the dual version of the conjecture leads to a generalization of the exten- 
sional form of the Los-Tarski theorem for sentences. To the best of our knowledge, 
our characterizations are the first to relate natural quantitative properties of models of 
sentences in a semantic class to the count of quantifiers in equivalent 3*V* or V*3* sen- 
tences. For arbitrary finite vocabularies, we also generalize the extensional version of 
the Los-Tarski theorem for theories. Furthermore, we present interpolant-based seman- 
tic characterizations of the same syntactic classes as considered above. 
The rest of the paper is organized as follows. In Section 2, we recall relevant notions, 
results and the aforementioned conjecture from [6]. Section 3 introduces a generaliza- 
tion of the classical notion of "preservation under extensions" and formulates a dual 
version of the conjecture in terms of this notion. In Section 4, we formally prove the 
dual formulation of the conjecture, thereby proving the original conjecture as well. In 
Sections 5 and 6, we consider natural generalizations of our results that yield a more 
general set of preservation theorems. Section 7 presents semantic characterizations of 
the same syntactic classes via interpolants. Finally, we conclude in Section 8 with some 
discussion and directions for future work. 

2 Background 

We assume that the reader is familiar with standard notation and terminology used in the 
syntax and semantics of FO (see [1]). A vocabulary r is a set of predicate, function and 
constant symbols. In this paper, we restrict ourselves lo finite vocabularies. We denote 
by FO{t) the set of all FO formulae over vocabulary t. A sequence (xi, . . . , Xk) of 
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variables is denoted by x. A FO{t) formula ij] having free variables x is denoted by 
^/'(a;). A formula with no free variables is called a sentence. A theory, resp. theory over 
T, is a set of sentences, resp. FO{t) sentences. We abbreviate a block of quantifiers 
of the form Qxi . . . Qxk by Qx, where Q E {V, 3}. We denote the natural numbers 
including zero by N. For every non-zero k G N, we denote by S'j*, (resp. U^), all 
FO sentences in prenex normal form, whose quantifier prefix begins with a 3 (resp. 
V) and consists of /c — 1 alternations of quantifiers. We use the standard notions of 
r-structures, substructures (denoted as M C TV) and extensions, as defined in [1], 
and study preservation theorems over arbitrary structures. By the size (or power) of 
a structure M, we mean the cardinality of its universe, and denote it by A class 
of structures is called elementary (resp. basic elementary) if it is definable by a FO 
theory (resp. an FO sentence). In this paper, we restrict ourselves to definability by 
FO sentences until Section 6. Subsequently, we relax this restriction to also include 
definability by formulae and theories. 

We begin by recalling a generalization of the notion of "preservation under substruc- 
tures", introduced in [6]. 

Definition 1 (ref. [6]) For k E N, a class S of structures is said to be preserved under 
substructures modulo fc-sized cores, denoted by S E P§C(fc), if for every structure 
M G S, there exists an at most k-sized subset C of the universe of M such that if 
N <Z M and N contains C, then N € S. The set C is called a core of Af w.rt. S. If S 
is clear from context, we simply call C a core of M. 

An example of a class in PSC(O) (and hence in P§C(fe) for every k G N) is the class of 
all acyclic directed graphs'. It is well known that this class is not FO-definable. Hence, 
P§C(fc) contains classes not definable in FO for every fc G N. Let PSC{k) denote the 
collection of FO-definable classes in P§C(fc). We identify classes in PSC{k) with their 
defining FO sentences. As an example, for fc G N, consider the class Sk of all graphs 
containing a k length cycle as a subgraph. It is clear that for any graph G in Sk, the 
vertices of any cycle of length fc in G form a core of G. Hence Sk G P§C(fc). Since 
Sk is definable using a sentence (f) having k existential quantifiers, we say that the 
defining sentence is in PSC{k). 

Since P§C(0) coincides with the property of preservation under substructures, we ab- 
breviate P§C(0) as PS and PSC{0) as PS in the following discussion. The substruc- 
tural version of the Los-Tarski theorem for sentences can now be stated as follows. 

Tlieorem 1 (Los-Tarski). A sentence is in PS iff it is equivalent to a 11^ sentence. 

In attempting a syntactic characterization of PSC{k) that generalizes Theorem 1, the 
statement of the following theorem was put forth as a conjecture in [6]. While it was 
shown to hold in several special cases, it was not resolved in its entirety. In this paper, 
we formally prove the conjecture in its generality. 

Tlieorem 2. A sentence is in PSC{k) iff it is equivalent to a S2 sentence with k exis- 
tential quantifiers. 

' A directed graph can be viewed as a r-structure where r = {E} and i5 is a binary predicate. 
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It is easy to see that given a S2 sentence (p = 3xi . . . Bz^Vy ip{xi, . . . , Xk, y) and a 
structure M such that M \= (f), the witnesses ai, . . . ,ak of xi, . . . ,Xk for which A/ \= 
My ip{ai, 02, ... , flfc, y) form a core of M. Therefore, 4> G PSC{k). However, contrary 
to intuition, witnesses and cores cannot always be equated! For example, consider the 
sentence (f) = 3x\/yE{x, y) £ PSC{1) and the structure M ~ {N, <) (i.e. the natural 
numbers with the usual ordering). Clearly, M ^ (p ^nd the only witness for x is the 
minimum element G N. In contrast, every singleton subset of N forms a core of Ml 
This is because, N being well-ordered by <, for every x e N, every substructure of 
M containing x has a minimum element. Therefore, there are many more cores than 
witnesses in this example. 

In Ught of Theorem 1, it is easy to see that for relational vocabularies, if 6 PS, then 
(j) must be equivalent to a sentence of the form ip = Vyi . . .Vyi 4'\{yi....,yi} for some 
I G N, where 4'\{yi,...,vi} is a quantifier-free relativized formula asserting that (f> is true 
in the substructure induced by yi, . . . , y; (see [6] for details). In other words, checking 
the truth of (f> (known to be in PS) in a structure M amounts to checking its truth for 
all finite substructures of M upto a suitably large size. In view of this, it is tempting to 
claim that if (f> G PSC{k), then checking the truth of in a structure M amounts to 
finding a subset C of M of size at most k and checking the truth of 4> in all suitably 
large but finite substructures of M that contain C. However, this claim is incorrect. To 
see why this is so, consider (j> = 3x\/yE{x,y) and the structure M = (Z, <) (i.e., 
integers with the usual ordering). Clearly cj) € PSC{1) and M ^ cp. However, every 
finite substructure of M has a minimum element, and hence models (pi This example 
illustrates a key difference between Theorem 1 and Theorem 2 . Specifically, although 
Theorem 2 asserts that every (p £ PSC{k) is equivalent to a sentence of the form 
3^\/*if where Lp is quantifier- free, it reveals no information about the form of tp. 
As defined in [6], let PSC = Ufe>o ^^'C-{k) and PSC = Ufc>o PSC{k). Then Theo- 
rem 2 yields the following corollary, which was proven using other techniques in [6] . 

Corollary 1 (ref. [6]). A sentence is in PSC iff it is equivalent to a S2 sentence. 

The next two sections introduce a notion dual to that of preservation under substructures 
modulo fc-sized cores, formulate a dual version of Theorem 2 using this notion, and 
provide a proof of the dual formulation. A proof of Theorem 2 follows immediately 
from the dual result. 

3 Preservation under fc-ary Covered Extensions 

The classical notion of "extension of a structure" can be naturally generalized to exten- 
sion of a collection of structures as follows. A structure M is said to be an extension 
of a collection R of structures if for each N £ R, we have N C M. We now define a 
special kind of extensions of a collection of structures. 

Definition 2 For fc £ N, a structure M is said to be a fc-ary covered extension of a 
non-empty collection R of structures if ( i) M is an extension of R, and ( ii) for every 
subset S, of size at most k, of the universe of M, there is a structure in R that contains 
S. We call R a /c-ary cover of M. 



5 



As an example, let M be a graph on n vertices and let R be the collection of all r sized 
induced subgraphs of M, where 1 < r < n. Then AI is a fc-ary covered extension of R 
for every fc in {0, . . . , r}. 

Note that a 0-ary covered extension of R is simply an extension of R. For fc > 0, the 
universe of a fc-ary covered extension of R is necessarily the union of the universes of 
the structures in R. However, different fc-ary extensions of R can differ in the inter- 
pretation of predicates (if any) of arity greater than fc. Note also that a fc-ary covered 
extension of R is an Z-ary covered extension of R for every Z G {0, . . . , fc}. 

Definition 3 Given fc G N, a class S of structures is said to be preserved under fc-ary 
covered extensions, denoted S G PCE(fc), if for every collection R of structures of S, 
if M is a k-ary covered extension of R, then M G S. 

An example of a class in PCE(fc) is the class Sk of all graphs not containing a cycle of 
length fc. Let M be a fc-ary covered extension of R, where i? is a collection of structures 
of Sk . It is easy to see that M is also in Sk ■ For if not, M must contain a cycle of length 
fc. As i? is a fc-ary cover of M, this cycle must be contained in some N E R. This 
contradicts the fact that N £ Sk- 

Let the collection of FO definable classes in PCE(fc) be denoted by PCE{k). As be- 
fore, we identify classes in PCE{k) with their defining FO sentences. It is easy to see 
that if I, fc G N and if I < fc, then PCE(0 C PCE(fc) and PCE{1) C PCE{k). Fur- 
thermore, the heirarchies within PCE and PGE are strict. Consider G PGE{k) over 
the empty vocabulary given hy ((> — \/xi . . .\/xk Vi<i<j<fc(2^j = ^j)- The sentence 
(j) asserts that there are strictly fewer than fc elements in any model. It is easy to see 
that 4> G PCE{k). To see that cj) ^ PCE {I) for I < fc, consider M containing exactly 
fc elements in its universe. Clearly AI ^ 0. Consider the collection R of all Z-sized 
substructures of AI. It is easy to check that i? is a Z-ary cover for AI. However each 
structure in R models (p. Then (f) ^ PCE{1) for I < fc. This shows the strict heirar- 
chy within PCE. The above argument also shows that PCE(Z) is strictly contained in 
PCE(fc) - (f) witnesses this strict inclusion. 

The classical notion of preservation under extensions is easily seen to coincide with 
PCE(O). This is because a class of structures S is preserved under extensions iff it 
is preserved under extensions of any collection R of structures in S. This motivates 
abbreviating PCE(O) as PE and PCE{0) as PE in the subsequent discussion. Anal- 
ogous to the definitions of PSC and PSC, we define PCE = Ufc>o ]PCE(fc) and 
PCE = Ufc>o PCE{k). The strictness of the PCE(fc) and PCE{k) hierarchies imply 
that PCE and PCE strictly generalize PE and PE respectively. 
With the above notation, the extensional version of the Los-Tarski theorem for sentences 
can be stated as follows. 

Theorem 3 (Los-Tarslii). A sentence is in PE iff it is equivalent to a sentence. 

The duality between P§C(fc) and PCE(fc) is formalized by the following lemma. 

Lemma 1 (P§C(fc)-PCE(fc) duality). A class S of structures is in P§C(fc) iff its com- 
plement S is in PCE(fc). 
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Proof : If: Suppose S G PCE(fc) but S i PSC(fc). Then there exists M e S s.t. for 
every set A of at most k elements from M, there is a substructure Na of M that contains 
A but is not in S. In other words, Na G S*. Then R = {TVa | A is a subset, of size 
at most fcjOf AI} is a fc-ary cover of M. Since A'^ G S for all ./Va G R and since 
5 e PCE(fc), it follows that M e S^- a contradiction. 

Only If: Suppose S e PSC(fc) but 'S ^ PCE(fc). Then there exists M S 5 and a fc-ary 
cover R of M such that every structure N E R belongs to S. Since M € S*, there exists 
a core C of M w.rt. S of size at most fc. Consider the structure Nc G i? that contains 
C - this exists since i? is a fc-ary cover of M. Then Nc G -S* since C is a core of il/ - a 
contradiction. ■ 

Corollary 2. Lef cpbeaFO sentence. Then (p e PSC{k) ijf^cj) e PC Elk). 

As seen earlier, all Z"" sentences with fc existential quantifiers are in PSC{k). By Corol- 
lary 2, all sentences with fc universal quantifiers are in PCE{k). In the next section, 
we show that the converse is also true, yielding the following theorem. 

Theorem 4. A sentence is in PCE{k) iff it is equivalent to a sentence with k 
universal quantifiers. 

Theorem 4 and Corollary 2 together prove Theorem 2. Theorem 4 also yields a new 
characterization of the 77" fragment of FO, as given by the following corollary. 

Corollary 3. A sentence is in PCE iff it is equivalent to a II2 sentence. 

4 Proof of Theorem 4 

We begin by recalUng some notions from classical model theory [1]. Given a vocabu- 
lary T and a cardinal a, let be the vocabulary obtained by expanding r with fresh 
constants ci, . . . , c^. Given a r-structure M, the theory of A7, denoted Th{M), is the 
set of all FO{t) sentences true in M. Given r-structures M and N, we call A7 an el- 
ementary extension of if for all fc G N, for all FO{t) formulae . . . , .Xfc) and 
for all fc-tuples a from N, M \= (p{a) O TV |= ip{a). A r-type S{v) is a maximally 
consistent set of r-formulae having a single free variable v. In other words, for every 
T-formula tp{v), exactly one of tp or belongs to S{v). A structure M is said to 
realize the type Siv) if there is an element a of M such that M 1= IJ{a). Finally, we 
recall the notion of saturation, which is crucially used in our proof. 

Definition 4 (Saturation, ref. [1]) Given a cardinal X, a r-structure M is said to be 
X-saturated if for every subset X = {61 , . . . , 6^} of the universe of M such that a < X, 
the Tq, expansion [M, 61, ... , ba) realizes every Ta-type S{v) that is consistent with 
Th{M, 61,..., 60). 

Our proof makes use of the following results from Chapter 5 of [ 1 ] . 

Proposition 1 (ref. [1]). Given an infinite cardinal X and a X-saturated r-structure 
M, for every k-tuple (ai, . . . , a^) of elements from M where fc G N, the rk structure 
{M, fli, . . . , afe) is also X-saturated. 
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Proposition 2 (ref. [1]). A r-structure is finite iff it is X-saturatedfor all cardinals A. 

Theorem 5 (ref. [1]). Let r be a finite vocabulary, X be an infinite cardinal and M be 
a T-structure such that u < \M\ < 2^ (\M\ denotes the power of M). Then there is a 
P-saturated elementary extension of M for some cardinal /3 > A. 

Theorem 6 (ref. [1]). Given r-structures M and N and a cardinal X, suppose that ( i) 
M is X-saturated, (ii) X > \N\, and (Hi) every existential sentence true in N is also 
true in M. Then N is isomorphically embeddable in M. 

Putting Theorem 5 and Proposition 2 together, we get the following. 

Corollary 4. Let t be a finite vocabulary. For every r-structure M, there exists a /3- 
saturated elementary extension of M for some cardinal P > ui. 

Towards our syntactic characterization of PCE{k), we first prove the following. 

Lemma 2. Let t be a finite vocabulary and let T be a consistent theory over t. Let F 
be the set of all consequences ofF. Then for all infinite cardinals X, for every 

X-saturated structure M, if M \= F, then there exists a k-ary cover R of M such that 
N h Ffor every N e R. 

Proof: We show that for every subset S, of size at most k, of the universe of M, there 
is a substructure Ms of M containing 5* such that Mg |= F. Then the set K = {Ms \ 
S* is a subset, of size at most of the universe of M } forms the desired fc-ary cover of 
M. Let S — {fli, . . . , flr} be a subset of the universe of M, where r < A:. To show 
the existence of Ms, it suffices to show that there exists a r^-structure such that (i) 
|A^| < A, (ii) every 3* sentence true in N is also true in (M, ai, . . . ,0^), and (iii) 
TV 1= T. Since M is A-saturated, by Proposition 1, (M, ai, . . . , a^) is also A-saturated. 
Then, from Theorem 6, N is isomorphically embeddable into (M, ui , . . . , a^). Then the 
r-reduct of the copy of N in (A/, ai, . . . , a, ) can serve as Ms- The proof is therefore 
completed by showing the existence of N with the above properties. 
Let P be the set of all V* sentences of FO{Tr) that are true in (A/, ai, . . . , a,)- Suppose 
= T U P is inconsistent. By the compactness theorem, there is a finite subset of Z 
that is inconsistent. Since P is closed under taking finite conjunctions and since each 
of P and F is consistent, there is a sentence if) m P such that F U {V'} is inconsistent. 
In other words, F — > -i?/;. Since T is a theory over r and is a sentence over r^, by V- 
introduction, we have F (p, where (p = Vcci . . . Vxr^iplci 1— >• xi; . . . ; Cr n> Xr], the 
variables xi, . . . ,Xr are fresh, and Cj H> Xj denotes substitution of Ci by Xi. Since is 
a 3* sentence over t,., (pis a VB* sentence over r. Since r < k,(p can be seen as a 
sentence (by introducing redundant Vs if r < k). By the definition of F, we must have 
(fi E F, and hence M \= if. In other words, (M, oi, . . . , a^) \= ^i^. This contradicts 
the fact that ^jj £ P. Therefore, Z must be consistent. By Lowenheim-Skolem theorem, 
there is a model of Z of power at most A. Since N models every V* sentence true in 
(M, ai, . . . , ar), every 3* sentence true in N must be true in (A/, ai, . . . , a^). Finally, 
since iV 1= T, iV is indeed as desired. ■ 
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We complete the proof of Theorem 4 now. If cj) is unsatisfiable, we are done. Otherwise, 
let r be the set of all \J^3* consequences of 0. Clearly, <j> ^ F. For the converse, sup- 
pose AI 1= r. By Corollary 4, there is a /?— saturated elementary extension of M 
for some > uj. Then A/+ |= F. Taking T ~ {(/)}, by Lemma 2, there exists a fc-ary 
cover R of M+ such that for every N eR,N i.e. N ^ cj). Since e PCE{k), it 
follows that M"*" 1= (/). As M+ and M are elementarily equivalent, M |= and hence 
F ^ (p. This shows that o -T. By the compactness theorem, (p is equivalent to a 
finite conjunction of sentences of F. Since is closed under finite conjunctions, (p is 
equivalent to a V'°3* sentence. ■ 

We remark that the above proof goes through over any class of structures satisfying the 
compactness theorem. As a special case then. Theorem 4 and (hence) Theorem 2 are 
true modulo theories. Thus, we get a complete subsumption of the Los-Tarski theorem 
for sentences in both its senses, primal and dual. 

5 Finite Cores and Finitary Covers 

We recall from [6] the following notion which generalizes P§C(fc). 

Definition 5 (ref. [6]) A class S of structures is said to be preserved under substruc- 
tures modulo a finite core, denoted S G PSC /, if for every structure M e S, there 
exists a finite subset C of the universe of M such that if N ^ M and N contains C, 
then N ^ S. The set C is called a core of M w.rt. S. 

As an example, the class S of graphs containing cycles is in PSC/. Since PSC/ con- 
tains classes like S that are not FO definable, we let PSCf denote the collection of 
FO definable classes in PSC/. We identify classes in PSCf with their defining FO 
sentences. The following results were then proved. 

Theorem 7 (ref. [6]). A sentence is in PSCf iff it is equivalent to a S2 sentence. 
Corollary 5 (ref. [6]). PSCf = PSC. 

Lemma 3 (ref. [6]). For every recursive function / ; N ^> N, there is a sentence 
(j) G PSCf which is not in PSC{k) for any k < f{\4>\). 

We now give analogous notions and results in the dual setting. We first define the notion 
of a finitary covered extension which is a natural generalization of the notion of a fc-ary 
covered extension introduced in Section 3. 

Definition 6 A structure M is said to be a finitary covered extension of a collection R 
of structures if (i) M is an extension of R (ii)for every finite subset S of the universe of 
M, there is a structure in R containing S. We then call R as a finitary cover of M. 

If M is a finitary covered extension of R, then R is necessarily non-empty. Further, M 
is the unique finitary covered extension of R since all predicates and function symbols 
have finite arity. Finally, M is also a fc-ary covered extension of R for all fc G N. 
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Definition 7 A class S of structures is said to be preserved under finitary covered ex- 
tensions, denoted S G PCE f, if for every collection R of structures of S, if M is a 
finitary covered extension of R, then M G S. 

It is easy to see that PCE C PCE / . Since PCE contains non-FO definable classes, these 
are also in PCE/ and hence let PCEf denote the collection of FO definable classes in 
PCE/. As usual, we identify classes in PCEf with their defining FO sentences. We 
now have the following duality result similar to Lemma 1 . The proof is exactly like the 
proof of the latter -just replace 'fc' in the latter proof by 'finite'. 

Lemma 4 (PSC/-PCE / duality). A class S of structures is in PSC / iff its complement 

5 is in PCE/. In particular, ifcf) is a FO sentence, then (p e PSCf iff^cf) G PCEf. 

Lemma 4 and Theorem 7 give us the following characterization of PCEf. 

Tlieorem 8. A sentence is in PCEf iff it is equivalent to a TTj sentence. 

We remark that this result has an alternate proof very similar to that of Theorem 4. We 
now get a result analogous to Corollary 5. 

Corollary 6. PCEf = PCE. 

Finally, we have Lemma 5 below analogous to Lemma 3. 

Lemma 5. For every recursive function / : N ^ N, there is a sentence (f> £ PCEf 
but which is not in PCE{k) for any k < f(\4>\)- 

Proof: Suppose there is a recursive function / : N — > N such that if G PCEf, then 
(/) G PCE{k) for some k < /(|0|). Then consider the function g : N — !> N given by 
g{n) ~ f{n + 1). Clearly g is also a recursive function. Now let be a sentence in 
PSCf. We will show that (j) G PSC{k) for some k < g{\(j)\). This would contradict 
Lemma 3 and complete our proof. 

Since (j) G PSCf, by Lemma 4, it follows that -i0 G PCEf. Then by our assumption 
above, ^(/) G PC£;(fc) for some fc < /(h(/)|) = /(1 + |0|) = Then by Corollary 

2, we have (/> G PSC{k) for some k < g{\4>\). M. 

6 Generalizations to formulae and theories 

In this section, we generalize the semantic classes PSC, PCE and various subclasses 
of these seen earlier This is done by relaxing the meaning of FO definability to in- 
clude definability by theories (as opposed to definability by FO sentences used so far). 
Specifically, the classes PSCf , PSC, PSC{k), PCEf , PCE and PCE{k) are now 
(re-)defined to be subclasses of PSC / , PSC, PSC(fc) , PCE / , PCE and PCE(fc), respec- 
tively, that are definable by FO theories. While a theory is conventionally a set of sen- 
tences, we define a theory with free variables x to be a set of FO formulae, each of which 
has free variables x. Let T{x) be a r-theory with free variables x, and let T' be the t„- 
theory obtained by replacing each Xi with ci for i G {l,...,n}, where ri = |x| and the 
Ci's are fresh constant symbols. For each class C in {PSCf, PSC, PSC{k), PCEf, 
PCE, PCE{k)}, we say that T G C iff T' G C. The above generalizations of semantic 
classes lead to natural generalizations of the preservation theorems seen earher 
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Theorem 9. Let T{x) be a theory with free variables x. 

1. (Gen. of Theorem 8) T{x) G PCEf iffT{x) is equivalent to a theory of 
formulae with free variables x. 

2. (Gen. of Theorem 4) T{x) £ PCE{k) iffT{x) is equivalent to a theory of 
formulae, each having free variables x and k universal quantifiers. 

The proof of each part of Theorem 9 is obtained by a straightforward adaptation of the 
proof of the corresponding theorem it generalizes. Putting A; = in Theorem 9(2), we 
obtain the extensional version of the Los-Tarski theorem for theories with free variables. 
The proof of equivalence of PCE and PCEf forFO sentences (see Corollary 6) can be 
easily adapted to work for FO formulae as well. However, as Lemma 6 shows, PCEf 
strictly subsumes PCE for FO theories. 

Lemma 6. PCE C PCEf forFO theories. 

Proof : That PCE C PCEf for theories is obvious. To prove the lemma, we present a 
theory of TTj* sentences that is not equivalent to any theory of V'^ B* sentences, for any 
k G N. Let T be a TTj* theory over graphs that asserts that there is no cycle of length k 
for any fc S N. The theory T defines the class S of all acyclic graphs. If T is equiva- 
lent to a theory of V'^'B* sentences for some fc G N, then by Theorem 9(2), S must be 
in PCE{k). Hence, by Lemma 1, S (the complement of S) must be in P§C(fc). Now 
consider a cycle G of length fc + 1. Clearly, G G S*, although every proper substructure 
of G is in S. This contradicts that S G P§C(fc). ■ 

In contrast to the syntactic characterizations for theories in PCE and PCEf, we do 
not yet have syntactic characterizations for theories in PSC{k) and PSCf. The proof 
of Theorem 2 for sentences can be easily adapted to work for individual formulae in 
PSC{k). Recall that this proof proceeds by characterizing the negations of sentences 
in PSC{k). Unfortunately, the same approach cannot be taken for characterizing the- 
ories in PSC(k) because negations of theories need not be theories, as implied by the 
following result. 

Proposition 3 (ref. [1]). Suppose S and S are both elementary classes of structures. 
Then S and S are both basic elementary. 

Thus, if a theory T in PSC{k) defines a class S of structures, then while it is certain 
that 'S G PCE(fc), it need not be that 'S G PCE{k). Hence 'S need not be definable by 
a theory. In which case, the characterization for theories in PCE{k) cannot be applied. 
A natural proposal for characterizing theories T in PSC{k) is to assert that T is equiv- 
alent to a theory of B'^V* sentences. However, consider the theory T = {3xE{x, x), 
3y^E{y, y)} and a graph G = {V, E) = ({a, 6}, {(a, a)}). It is easy to check that G 
cannot have a core of size 1. Thus, T ^ PSC{\), and the proposal is falsified. A modi- 
fied proposal asserts that T G PSC{k) iff T is equivalent to an infinitary logic sentence 
of the form 3'^x Aig/ where / is a set of indices and ipi is a Ul formula with 

free variables x, for each i £ I. It is easy to check that any sentence of this form is 
indeed in PSC{k). However, we have not yet been able to prove the converse. In the 
next section, we suggest a possible approach to the problem of characterizing theories 
in PSC{k) and PSCf. 
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7 Characterizations using Interpolants 

Given a theory T G PS, an interesting question is: Does there exist a finite subset of 
T which also is in PSl The following is a recent unpublished result by Parikli that he 
proved in our discussions with him (see [7] for a proof). 

Theorem 10 (Parikh). There is a theory in PS s.t. no finite subset of it is in PS. 

Given a theory T G PS, call a finite subset S* of T as well-behaved if S is in PS. 
Then Theorem 10 shows that there may not exist any well-behaved finite subset of T. 
We will however show below that for each finite subset S of T, there always exists, an 
underapproximation of it implied by T which is well-behaved. In other words, there is 
a sentence ^5 such that (i) T ^ and — >■ 5 (ii) ^5 G PS. Towards this, we recall 
from the literature [8] that, given theories Z and T and a sentence ip, a sentence ^ is 
said to be an interpolant between T and tjj modulo ZifZI-(T— ?>^A^— ip). If Z 
is empty, then ^ is simply called an interpolant between T and tjj. The following result 
is a simple generalization of a result from [8]. There, the result below appears with a 
sentence instead of T. 

Proposition 4. Let Z, T be theories and ip be a sentence. The following are equivalent: 

1. IfM and N model Z, N <Z M and M ^ T, then N \= -ip. 

2. There is a interpolant ^ between T and modulo Z. 

We adopt two conventions in what follows: (a.) S Cf T denotes that S* is a finite subset 
of T. (b) We identify a finite theory with the (finite) conjunction of the sentences in it. 
Now, taking Z to be empty and t/j to be S, one sees that condition (1) of Proposition 4 
is true, yielding the following. 

Corollary 7. Given a theory T G PS and S T, there exists a Ui interpolant 
between T and S. 

Indeed is the well-behaved underapproximation of 5* we had referred to above. In- 
terestingly then, for a theory in PS, while the Los-Tarski theorem for theories states 
the existence of a universal theory equivalent to T, we can actually construct one such 
theory using the interpolants guaranteed by Corollary 7. 

Theorem 11. Let T be theory in PS and ^5 be a interpolant between T and S for 
S Qf T. Then T is equivalent to V ^ {^s \ S T}. 

Proof: For each S Cf T, we have T ^5; then T ^ V . Further since ^5 S, we 
have V where W = Asc^t A^es '^^ '^^eck that W ^T. ■ 

We now present a result similar to Proposition 4, which can be seen as a generalization 
of a dual version of the proposition. The proof below uses ideas similar to those used in 
proving Theorem 4. 

Proposition 5. Let Z, T be theories and ^ be a sentence. Then given k G N, the fol- 
lowing are equivalent: 
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1. Let R be a k-ary cover (resp. finitary cover) of M. Suppose M Z and for each 
N e R, N ^ ZUT. Then M h V'- 

2. There is aV'^B* (resp. 112) interpolant £^ between T and ijj modulo Z. 

Proof : We give the proof for fc-ary covers only. The proof for finitary covers is anal- 
ogous. Also the proofs modulo theories Z are analogous to the proof below which 
considers Z as empty. 

(2) (1): Since N \= T for each iV G i? and since ^ is an interpolant between T and 
ip, we have that ^ ^ for each N e R. Since ^ is a V'^B* sentence, ^ € PCE{k). 
Then M |= ^, as i? is a fc-ary cover of M. Finally since ^ is an interpolant between T 
and 1/), M ^ 

(1) — >■ (2): Let F be the set of all V'^B* consequences of T. We will show that F ^ ip- 
Then by the compactness theorem, a finite conjunction of sentences in F would imply 
ip. Since F is closed under finite conjunctions, we would get a single V'^El* sentence in 
F which would imply ijj. We can take this sentence to be the desired interpolant ^. 
Suppose M \= F. By Corollary 4, there is a /3— saturated elementary extension A/"*" of 
M for some f3 > uj. Then A/+ 1= F. By Lemma 2, there exists a fc-ary cover R of M+ 
such that N \= T for every N G R. Then by the premises as stated in (1), A/+ ^ V'- 
As A/+ and M are elementarily equivalent, A/ ^ t/'. This shows that F ip. ■ 

Corollary 8. G;Ven fc e N, a theory F e PCE{k) (resp. T G PCEf) and S Cf F, 
there exists a \/^3* (resp. j interpolant between F and S. 

This result gives the following alternate proof of Theorem 9 for theories. 

Theorem 12. Given a theory F € PCE{k) (resp. F G PCEf) , let be a V''3* 
( resp. 772 ) interpolant between F and S for S* C y T. Then F is equivalent to {^s \ 
S Cf F}. 

A natural question to ask in view of the above results is: Given a theory F in PSC{k), 
resp. PSCf, does there exist a El'"'V*, resp. IJ2, interpolant between F and S for 5 Cj 
T? We have no answer to this question yet. If this is indeed true, then analogous to 
Theorem 12, we would have that if T G PSG{k) (resp. T G PSCf), then F is equiv- 
alent to a theory of ^'""V* sentences (resp. IJ2 sentences). For theories F in PSC{k), 
one can even ask the following weaker question: Given 5 T, does there exist a S2 
interpolant between F and S'? If yes, then analogous to Theorem 12, T would be 
equivalent to a theory of S2 sentences. Observe that if F were indeed equivalent to a 
theory of IJ2 sentences, then for any S Cf F, we would have a IJ2 interpolant between 
F and S by the compactness theorem. However we do not have an answer to the above 
weaker question too. We remark that this approach may not give a characterization of 
theories in PSC{k) via infinitary logic sentences of the kind proposed in Section 6. 

8 Conclusion and Future Work 

In this paper, we presented preservation theorems that characterize the El'^'V* and V'^B* 
prefix classes of FO. These theorems can be viewed as generalizations of the substruc- 
tual and extensional versions of the Los-Tarski theorem. Our results contrast with ear- 
lier characterizations of S2 ^2 ' ^^^h as those using ascending chains, descending 
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chains and 1-sandwiches, which do not yield the Los-Tarski theorem as a special case. 
A few open questions remain in the context of FO theories. Important among these are 
syntactic characterizations of FO theories in PSC{k) and in PSCf, and an understand- 
ing of whether PSCf strictly subsumes PSC for FO theories. It is also interesting that 
the semantic notions of PSC{k) and PCEik) remain non-trivial over classes of finite 
structures. This contrasts with other semantic notions (like those mentioned above) that 
have been used earlier to characterize S2 and TT" over arbitrary structures, but reduce 
to trivial properties over any class of finite structures (see Appendix A for details). This 
motivates investigating classes of finite structures over which PSC{k) and PCE{k) se- 
mantically characterize 3'"'V* and V'"'3* sentences respectively. Some such classes were 
considered in [6]. Further investigations in this direction would be a natural extension 
of recent work on preservation theorems over special classes of finite structures [9, 10]. 

Acknowledgements: We are very grateful to Anuj Dawar, Rohit Parikh and Anand 
Pillay for valuable discussions and feedback. 
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A Comparing the notions of PSC and PCE with other related 
notions in the literature 

We present three notions from the literature that provide characterizations of IJ2 and 
JT2 over arbitrary structures. None of these characterizations relate the count of quan- 
tifiers in the IJ2 and TIj sentences to any quantitative property of their models. As a 
consequence, none of these yield the Los-Tarski theorem as a special case. We also 
show below that all the three notions become trivial over any class of finite structures. 

1. Preservation under unions of ascending chains: 
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An ascending chain is a sequence of structures Mi, M2, . . . such that Mi C il/2 C . . .. 
Given an ascending chain C, the union of the chain is the unique structure N such 
that (a) the union of the universes of the structures in C is exactly the universe of N 
(h) M C N for each M G C A sentence (p is said to be preserved under unions of 
ascending chains, if for every chain C, if all structures in C model (j), then the union of 
C also models (p. A classical theorem states that over arbitrary structures, (p is preserved 
under unions of ascending chains iff (/> is equivalent to a sentence [1]. 
Now consider any class V of finite structures and consider an ascending chain of struc- 
tures from v. One can check that either the union of the chain is not a finite structure 
or it is the same as some structure in the chain. Then over V, any sentence is preserved 
under unions of ascending chains! 

2. Preservation under intersections of descending chains: 

An descending chain is a sequence of structures Mi , M2 , ■ ■ ■ such that Mi D M2 3 . . . . 
Given an descending chain C, the intersection of the chain is a structure N such that 

(a) the intersection of the universes of the structures in C is exactly the universe of N 

(b) N C M for each M G C. Note that N exists iff the intersection of the universes 
of the structures in C is non-empty. Further, it is unique if it exists. A sentence (j) is 
said to be preserved under intersections of descending chains, if for every chain C, if 
all structures in C model 0, then the intersection of C, if it exists, also models (p. A 
classical theorem states that over arbitrary structures, (p is preserved under intersections 
of descending chains iff p is equivalent to a II2 sentence [1]. 

Now consider any class V of finite structures and consider a descending chain of struc- 
tures from V. One can check that the intersection of the chain must necessarily be the 
same as some structure in the chain. Then over V, any sentence is preserved under in- 
tersections of descending chains ! 

3. Preservation under 1 -sandwiches: 

A notation before proceeding: By M ^ N, we mean that M is an elementary substruc- 
ture of N. 

Given structures M and N, we say M 1 -sandwiches N if there exist structures M' and 
N' such that (i) M ^ M' (ii) N < N' and (iii) M C N' C M' . We say that (j) is 
preserved under 1 -sandwiches if it is the case that \f N (p and M 1 -sandwiches N, 
then M ^ p. A classical theorem states that (p is preserved under 1 -sandwiches iff it is 
equivalent to a 77" sentence [ 1 ] . 

Since one can capture a finite structure upto isomorphism using a single FO sentence, it 
follows that given two finite structures M and M' , M < M' implies that M is isomor- 
phic to M' . Now consider any class V of finite structures and let A7 and N be structures 
from V. Then if M 1 -sandwiches N, it follows from our observation above that M must 
be isomorphic to N . Once again then, any sentence is preserved under 1 -sandwiches! 

In contrast to the three notions considered above, consider the notions of PSC{k) and 
PCE(k) introduced in [6] and in the present paper Because these notions allow us to 
obtain preservation theorems (Theorems 2 and 4) that relate the count of quantifiers in 
the leading block of quantifiers of 3*V* and V*3* sentences to quantitative properties 



15 



of their models, we obtain the substructual and extensional versions of the Los-Tarski 
theorem as special cases. In addition, the notions of PSC{k) and PCE{k) remain non- 
trivial over the class of all finite structures, amongst other classes of finite structures. 
In other words, for each k, there are atleast two sentences such that, over the class of 
all finite structures, one of these sentences is in PSC{k) and the other is not (like- 
wise for PCE{k)). Any sentence in PSC{k) over arbitrary structures would also be in 
PSC{k) over all finite structures (likewise for PCE{k)). As an example of a sentence 
that is not in PSC{k), consider the sentence = yx3yE{x, y). Let G be a cycle of 
length k + 1. This is a model of (j). However, no proper induced subgraph G" of G is 
a model of since G' must contain a vertex which has no outgoing edge. Then the 
only core of G is the set of all vertices of G - but this has size k + 1. This shows that 
(f> ^ PSG{k). (In fact, this argument shows that 4> ^ PSC). Likewise, by Corollary 2, 
tp — 3x\/yE{x, y) ^ PCE{k) (in fact, ^ PCE). This motivates studying classes of 
finite structures over which PSC{k) and PGE{k) do form semantic characterizations 
of the 17° and 77° classes of FO (the notions in the literature mentioned above surely 
cannot give us characterizations for these classes). Indeed, characterizations of S2 
ing PSC{k) were obtained over some interesting classes of finite structures in [6]. 



